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DETAILED ACTION 
Continued Examination Under 37 CFR 1.114 

1. A request for continued examination under 37 CFR 1.114 filed on 1 1/03/06, including the fee 
set forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set forth in 
37 CFR 1.17(e) has been timely paid, the finality of the previous Office action has been 
withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 10/04/06 has been 
entered. 

2. Applicant's arguments with respect to claims 1-17, 63 and 67 filed on 10/04/06 have been 
considered but are moot in view of the new ground(s) of rejection. 



Claim Rejections - 35 USC § 103 
3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 
rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 
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4. Claims 1-7, 9-13, 63 and 67 are rejected imder 35 U.S.C. 103(a) as being unpatentable over 
Okada et al. U.S. Patent 6,226,086 in view of Okada at al. U.S. Patent 5,969,757 and the 
applicants' admitted prior art. 

Referring to claim 1, the Okada ('086) reference discloses in Figures 4, 10 and 12, an 
image input unit capable of performing pixel shift photography, said image input unit 
comprising: a photographic optical system (optical series 2, See Col. 12, lines 42-43) which 
forms an image of a subject in a predetermined position; an image sensing unit (solid-state 
imaging element 5, see Col. 12, line 45) which generates image data corresponding to the 
image of the subject; a pixel shift mechanism (3 and 4, see Col. 12, line 44) which displaces 
a subject image by a predetermined amount relatively with respect to the image sensing unit 
(5) as shown in Figure 4 (See Col. 6, lines 38-67); a pixel shift mechanism control unit 
(control circuit 8) which controls said pixel shift mechanism so as to displace the image of 
the subject by the predetermined amount (e.g., Xr=l/2Px, Yr=l/2 Py, see Col. 7, lines 31- 
35); an image combining unit (image synthesizing circuit 6, see col. 12, lines 57-67) which 
generates image data for one image (synthetic image) by combining the image data for a 
plurality of images output before (e.g. image A is the image before the displacement) and 
after (e.g., image B is the image after the displacement considered as final picture) the 
displacement; and a judgment unit (e.g., operation judging circuit 10, see Col. 13, lines 1-8) 
which judges whether the pixel shift photography has been performed correctly or not, based 
on the image data for a plurality of images output before and after the displacement as 
shown in Figures 4, 12 and 13 (e.g., the Figure 12 clearly shows the image memory 3 1 for 
storing the image data A, image memory 32 for storing the image data B. The moving 
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amount is detected based on the amount of motion vector between the image data A and B by 
detecting unit 9, see Col. 14, Unes 50-67 and Col 15, lines 1-13. In Figure 13, when the 
moving amount dx > 1/1 OPx and dy>l/10Py, the pixel shift photography has been judged as 
unnormal so that the image synthesizing circuit 6 have to perform an additional operation 
such as interpolating image data as correction for forming a high-resolution synthesized 
image, see Col. 15, lines 50-65). However, the Okada ('086) reference does not explicitly 
the judgment unit which judges whether the pixel shift photography on the completed 
combined image has bee performed correctly or not. 

The Okada ('757) reference teaches in Figures 1 and 6, an image input unit capable of 
performing pixel shift photograph, said image input unit comprising: a judgment unit (30) 
which judges whether the pixel shift photography on the completed combined image (23) 
has been performed correctly or not, based on the image data for a plurality of images (21 
and 22) output before and after the displacement of the imaging sensing imit (13) (e.g., 
judges whether a moire has been produced over a predetermined value. When the produced 
moire over a predetermined value is considered as the pixel shift photography has not been 
performed correctly, the system initiates the moire removal operation, see Col. 12, lines 12- 
38). The Okada ('757) reference is evidence that one of ordinary skill in the art at the time to 
see more advantages the image input device having more flexible methods to perform the 
pixel shift photography, e.g., providing a judgment unit which judges whether the pixel shift 
photography on the completed combined image has been performed correctly or not so that 
allows production of both images with the normal resolution and images with the higher 
resolution through the use of a compact and inexpensive configuration, and an optimal 
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configuration for removing a moire using an image shifting mechanism (See Col. 3, lines 
26-37). For that reason, it would have been obvious to one of ordinary skill in the art to 
modify the image input unit of Okada ('086) by providing the judgment unit which judges 
whether the pixel shift photography on the completed combined image has bee performed 
correctly or not as taught Okada ('757). 

The Okada ('086) reference does not explicitly show the shift mechanism displacing the 
image-sensing unit instead of displacing the transparent planes 3 a and 4a. 

The applicants' admitted prior art teaches in Figure 27A-C, three typical examples for the 
conventional image shift mechanism, the Figure 27A shows a CCD shift method, the Figure 
27B shows a LPF gradient method and the Figure 27c shows a lens shift method. The 
applicants' admitted prior art is evidence that one of ordinary skill in the art at the time to see 
more advantages the image input device having more flexible methods to perform the pixel 
shift photography so that the desired image quality can be obtained easily (See applicants' 
specification, page 2, line 19 through page 3, line 20). For that reason, it would have been 
obvious to one of ordinary skill in the art to modify the image input unit of Okada ('086) by 
providing the shift mechanism displacing the image-sensing unit for obtaining high quality 
image as taught by applicants' admitted prior art. 

Referring to claim 2, the Okada ('086), Okada ('757) and applicants' admitted prior art 
disclose all subject matter as discussed with respected to claim 1, and the Okada ('086) 
reference discloses wherein said judgment imit (10) comprises: a pixel shift evaluation value 
calculation unit (motion vector calculator 33, see col. 14, lines 56-61) which calculates a 
pixel shift evaluation value forjudging whether the pixel shift photography has been 
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normally performed or not as shown in Figure 13, based on the image data for a plurality of 
images output before (e.g., image A) and after (e.g. image B) the displacement of said image 
sensing unit (See applicants' Figure 27A); and a pixel shift photography judgment unit 
(judgment circuit 10) which judges whether the pixel shift photography has been normally 
performed or not, based on the pixel shift evaluation value calculated by said pixel shift 
evaluation value calculation unit as shown in Figure 13. 

Referring to claim 3, the Okada C086), Okada ('757) and applicants' admitted prior art 
disclose all subject matter as discussed with respected to claim 2, and the Okada ('086) 
reference discloses wherein said pixel shift evaluation value calculation unit calculates an 
amount of shift between the image data for the plurality of images output before and after the 
displacement of said image sensing unit (e.g., amount motion vector between image A and 
image B, see Col. 4, lines 49-62), as the pixel shift evaluation value; and said pixel shift 
photography judgment unit judges whether the pixel shift photography has been performed 
normally, based on the amoimt of shift calculated by said pixel shift evaluation value 
calculation unit as shown in Figures 10 and 13. 

Referring to claim 4, the Okada C086), Okada ('757) and applicants' admitted prior art 
disclose all subject matter as discussed with respected to claim 3, and the Okada ('086) 
reference discloses wherein when calculating the amount of shift between the image data for 
the plurality of images, said pixel shift evaluation value calculation unit calculates each 
amount of shift (e.g., X=Xr+dx and Y=VrH-dy) for a plurality of areas of the image data as 
shown in Figure 4. 
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Referring to claim 5, the Okada ('086), Okada ('757) and applicants' admitted prior art 
disclose all subject matter as discussed with respected to claim 4, and the Okada ('086) 
reference discloses wherein said pixel shift photography judgment unit judges that the pixel 
shift photography has been performed normally when a part of or the whole of the amount of 
shift in the plurality of areas calculated by said pixel shift evaluation value calculation unit is 
within a predetermined range as shown in Figure 13 (e.g., whether or not the moving amount 
is great than a predetermined value, see Col. 15, lines 1-13). 

Referring to claim 6, the Okada ('086), Okada ('757) and applicants' admitted prior art 
disclose all subject matter as discussed with respected to claim 4, and the Okada ('086) 
reference discloses wherein said pixel shift photography judgment unit judges that the pixel 
shift photography has not been performed normally when a part of or the whole of the 
amount of shift in the plurality of areas calculated by said pixel shift evaluation value 
calculation unit is out of the predetermined range (when the moving amount is great than a 
predetermined value, dx>l/10Px, or dy>l/10Py) and there is a predetermined relation in the 
amount of shift in the plurality of areas as shown in Figure 13. 

Referring to claim 7, the Okada ('086), Okada ('757) and applicants' admitted prior art 
disclose all subject matter as discussed with respected to claim 4, and the Okada ('086) 
reference discloses wherein said pixel shift photography judgment unit judges that the pixel 
shift photography has been performed normally, but a part of the subject has moved (e.g., the 
image subject has moved by an unstable vibration as blurring), in the case where a part of or 
the whole of the amount of shift in the plurality of areas calculated by said pixel shift 
evaluation value calculation unit is out of the predetermined range, but there is no 
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predetermined relation in the amount of shift in the plurality of areas as shown in Figure 13, 
steps S33-S34. 

Referring to claim 9, the Okada ('086), Okada ('757) and applicants' admitted prior art 
disclose all subject matter as discussed with respected to claim 2, and the Okada ('086) 
reference discloses wherein said pixel shift evaluation value calculation unit calculates the 
coincidence degree (by using point matching method is considered as calculating the 
coincidence degree for detecting amount of moving, see Col. 14, lines 51-62) for a target 
image data, based on an image data output by said image sensing unit before and after being 
displaced, as the pixel shift evaluation value; and said pixel shift photography judgment unit 
judges whether the pixel shift photography has been performed normally, based on the 
coincidence degree calculated by said pixel shift evaluation value calculation unit as shown 
in Figure 13. 

Referring to claim 10, the Okada ('086), Okada ('757) and applicants' admitted prior art 
disclose all subject matter as discussed with respected to claim 9, and the Okada ('086) 
reference discloses wherein said pixel shift evaluation value calculation unit calculates the 
coincidence degree, respectively, for the plurality of areas (each pixels in the image plane) of 
the image data, at the time of calculating the coincidence degree as shown in Figures 18-20. 

Referring to claim 1 1, the Okada ('086), Okada ('757) and applicants' admitted prior art 
disclose all subject matter as discussed with respected to claim 10, and the Okada ('086) 
reference discloses wherein said pixel shift photography judgment xmit judges that the pixel 
shift photography has been performed normally when a part of or the whole of the 
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coincidence degree (pint matching) in the plurality of areas calculated by said pixel shift 
evaluation value calculation unit (9) is within a predetermined range (1/lOPx, or 1/lOPy). 

Referring to claim 12, the Okada C086), Okada ('757) and applicants' admitted prior art 
disclose all subject matter as discussed with respected to claim 10, and the Okada ('086) 
reference discloses wherein said pixel shift photography judgment unit judges that the pixel 
shift photography has not been performed normally when a part of or the whole of the 
coincidence degree (point matching for calculating the amount of motion vectors) in the 
plurality of areas calculated by said pixel shift evaluation value calculation unit is out of the 
predetermined range, and there is a predetermined relation in the coincidence degree in the 
plurality of areas as shown in Figure 13. 

Referring to claim 13, the Okada ('086), Okada ('757) and applicants' admitted prior art 
disclose all subject matter as discussed with respected to claim 10, and the Okada ('086) 
reference discloses wherein said pixel shift photography judgment xmit judges that the pixel 
shift photography has been performed normally, but a part of the subject has moved (e.g., the 
image subject has been moved by an unstable vibration as blurring), in the case where a part 
of or the whole of the coincidence degree (point matching for calculating the amount of 
motion vectors) in the plurality of areas calculated by said pixel shift evaluation value 
calculation unit is out of the predetermined range, but there is no predetermined relation in 
the coincidence degree in the plurality of areas as shown in Figure 13, steps S33-S34. 

Referring to claim 63, the Okada ('086), Okada ('757) and applicants' admitted prior art 
disclose all subject matter as discussed with respected same comments to claim 1. 
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Referring to claim 67, the Okada ('086), Okada ('757) and applicants' admitted prior art 
disclose all subject matter as discussed with respected same comments to claim 1. 

5. Claims 8, 14 and 16-17 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Okada et al. U.S. Patent 6,226,086 in view of Okada et al. U.S. Patent 5,969,757, the 
applicants' admitted prior art and Kondo et al. U.S. Patent 5,731,849. 

Referring to claim 8, the Okada ('086), Okada ('757) and applicants' admitted prior art 
disclose all subject matter as discussed with respected to claims 1-4, and the Okada ('086) 
reference discloses the judgment unit (10) judges whether the pixels shift photograph has 
been performed normally, based on the amount of shift in the plurality of areas and the 
motion vector. However, the Okada ('086) reference does not explicitly has a detail about 
the amount of the motion vectors related to the reliability evaluation data for indicating the 
reliability of each amount of shift in the plurality of areas. 

The Kondo reference teaches in Figure 1, a motion vector detecting apparatus calculating 
the reliability of the motion vector which is detected in the plurality of areas and weighting 
process according to the reliability evaluation is executed to the movement vector when there 
is different motions inherent exist (See Col. 7, lines 53-67). The Kondo reference is 
evidence that one of ordinary skill in the art at the time to see more advantages the amount of 
the motion vectors related to the reliability evaluation data for indicating the reliability of 
each amount of shift in the plurality of areas so that the detection precision of the motion 
vector can be significantly improved and the vibration detection is optimized (See Col. 8, 
lines 20-33). For that reason, it would have been obvious to one of ordinary skill in the art to 
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modify the image input unit of Okada ('086) by providing a reliability evaluation unit which 
calculates reliability data indicating the reliability of each amount of shift in the plurality of 
areas as taught by Kondo ('849). 

Referring to claim 14, the Okada ('086), Okada C757), applicants' admitted prior art and 
Kondo references disclose all subject matter as discussed with respected same comments to 
claims 8 and 10, and references discloses wherein said judgment unit comprises a reliability 
evaluation unit which calculates reliability data indicating the reliability of each coincidence 
degree in the plurality of areas calculated by said pixel shift evaluation value calculation unit; 
and said pixel shift photography judgment unit judges whether the pixel shift photography 
has been performed normally (e.g., depend on amount of moving), based on the coincidence 
degree in the plurality of areas and the reliability data as shovm in Figures 13 and 18-20 of 
Okada '086). 

Referring to claim 16, the Okada ('086), Okada ('757), applicants' admitted prior art and 
Kondo disclose all subject matter as discussed with respected same comments to claim 8, and 
the Kondo reference discloses wherein said reliability evaluation unit calculates the 
reliability data based on the contrast of the image within the range of each of the calculation 
area (e.g., judging an effective area is set to the peak center and a map having a weight 
coefficient distribution according to position information which occupies in the areas of each 
of the blocks. See Col. 7, lines 25-30 and Col. 8, lines 5-15). 

Referring to claim 17, the Okada ('086), Okada ('757), applicants' admitted prior art and 
Kondo references disclose all subject matter as discussed with respected same comments to 
claims 14 and 16. 
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6. Claim 15 rejected under 35 U.S.C. 103(a) as being unpatentable over Okada et al. U.S. Patent 
6,226,086 in view of Okada et al. U.S. Patent 5,969,757, the applicants' admitted prior art 
and Onuki U.S. Patent Publication 2002/0097324. 

Referring to claim 15, the Okada ('086), Okada ('757) and applicants' admitted prior art 
disclose all subject matter as discussed with respected to claim 1, except the Okada ('086) 
reference does not explicitly show an informing unit which informs of the judgment resuh of 
said pixel shift photography judgment unit. 

The Onuki reference teaches in Figure 46, an image sensing apparatus, which performs 
pixel shifting operation and including an informing unit (display) which informs (waming 
message) of the judgment result of the pixel shift photography judgment imit (e.g., when the 
luring is large, a waming message is displayed when pixel shifting operation is determined. 
See page 29, paragraph [0054]). The Onuki reference is evidence that one of ordinary skill in 
the art at the time to see more advantages the image input unit including an informing unit 
which informs of the judgment result of said pixel shift photography judgment unit so that 
easily waming a user of an image not being obtained in desired resolution, or an altemative 
suggestion to be followed for improving resolution of the image and reducing the effect of 
movement of an object while performing pixel shifting (see page 3, lines 13-15 and [0031]). 
For that reason, it would have been obvious to one of ordinary skill in the art to modify the 
image input unit of Okada ('086) by providing an informing unit which informs of the 
judgment result of the pixel shift photography judgment unit as taught by Onuki ('324). 
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Conclusion 



7. Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Lin Ye whose telephone number is (571) 272-7372. The examiner can 
normally be reached on Mon-Fri 8:00AM-5:00PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David L. Ometz can be reached on (571) 272-7593. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published 
applications may be obtained from either Private PAIR or Public PAIR. Status information 
for unpublished applications is available through Private PAIR only. For more information 
about the PAIR system, see http://pair-direct,uspto.gov. Should you have questions on access 
to the Private PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 
(toll-free). If you would like assistance from a USPTO Customer Service Representative or 
access to the automated information system, call 800-786-9199 (IN USA OR CANADA) or 
571-272-1000. 
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Primary Examiner 
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